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A KIT FOR RECORDING OR TRANSMITTING INFORMATION OF A FORM AND OF A 

NOTE IN FREEHAND 



CROSS-REFERENCE TO RELATED APPLICATIONS 

[001] This is a continuation-in-part of application Serial No. (not yet assigned), filed on 
November 2, 2001 , that is still pending, which is a continuation of Serial No. 09/321 ,466 
filed on May 27, 1999. 

BACKGROUND OF THE INVENTION 

Field of the invention 

[002] This invention relates to a kit for recording or transmitting information of a form and 
of a note in freehand. 
Discussion of related art 

[003] Entering data in personal computers is accomplished in many ways including a 
keyboard, downloading from a network, insertion of a floppy disk or CD-ROM or a pointing 
device, or mouse. 

[004] Another way of entering data, usually by artists, is a graphics tablet, a flat board with 
a working surface on which a user draws with a special purpose pen-like stylus to create 
special effects on the computer screen. 

[005] When a keyboard is used to enter data into a computer, a program or application 
software must be present and active to receive the data, act on the data or merely accept 
the data. If one wants to enter simple data of the kind one normally writes on a desk pad, 
keyboard entry is not practical. Moreover, most persons prefer to write short notes rather 
than entering them into a computer via a keyboard or a special purpose stylus on the 
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plastic surface of a graphics tablet. That is why one finds a pen and paper on practically 
every desk. 

[006] A popular mans of writing notes is the use of a pen and sticky notes, called Post-it™ 
notes, which can be found on most desks at home and the office. Information on these 
notes is of interest to the user for a variety of home and office purposes such as telephone 
numbers, appointments or specific instructions to others or to oneself to take some sort of 
action. Most persons feel very comfortable writing something down on a piece of paper, 
particularly when recording a quick thought, while speaking on the telephone or to another 
person nearby or recording small bits of information. 

[007] In today's computer-dependent society, however, that same person will very 
probably wish to enter the information into his/her computer for a variety of critical 
purposes. Among these is to save the information for later recall; sending the information 
to another person in the office or in another city; verifying, or attaching, a signature; or 
sending a sketch or doodle. 

[008] Combining the ubiquitous sticky notes with modern electronics and the Internet 
would be a very useful way of solving the problems of saving and sending information, in a 
very friendly, practical and inexpensive manner. 
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SUMMARY OF THE INVENTION 

[009] The invention provides a kit for recording or transmitting information of a form and a 
note in freehand. The kit includes a plurality of forms and a unit for relaying information of 
one of the forms and a note in freehand created on that form. The unit includes a pad 
having a surface on which a form of the plurality of forms can be positioned. The pad 
includes a housing, and secured to the housing, a positioned sensor, a signal converter, 
and a transmitter. The positioned sensor takes the position of a writing instrument when 
the form is located on the surface and the writing instrument is used to create a suite of 
gestures on the form indicating the desire to provide display or store an image of the form 
and information of the note in freehand. The signal converter receives the suite of 
gestures and the information of note in freehand from the position sensor and converts the 
information to a signal. The transmitter receives the signal from the signal converter and 
transmits the signal to a remote location. 

[010] The invention also provides for a computer receiving the signal from a receiver. The 
computer determines which of a plurality of computer-level templates corresponds to the 
form based on the suite of gestures. The template is used to provide a two-dimensional 
layout substantially similar to the ink printed on the form. Upon selecting the template, the 
template is used to display an image of the freehand note on a computer display. The two- 
dimensional image of the freehand note and the template may also be stored in a 
datastore. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[011] The invention is further described by way of example with reference to the 
accompanying drawings wherein: 

[012] Figure 1 is a plan view of a kit, for recording a note in freehand, according to an 
embodiment of the invention; 

[013] Figure 2 is a plan view of a notesheet forming part of the kit; 
[014] Figure 3 is a bottom view of the notesheet; 

[015] Figure 4 is a side view of a stack of the notesheets of Figure 2 and Figure 3; 

[016] Figure 5 is a perspective view of a desk unit forming part of the kit; 

[017] Figure 6 is a sectioned side view of the desk unit; 

[018] Figure 7 is a block diagram of components forming part of the desk unit; 

[019] Figure 8 is a block diagram of a receiver/connector assembly for receiving 

information from the desk unit, and a computer to which the receiver/connector assembly is 

connected; 

[020] Figure 9 is a visual representation of a program which is stored on a CD-ROM or 
other computer readable medium forming part of the kit; 
[021] Figure 10 is a block diagram of the computer of Figure 8; 

[022] Figure 1 1 is a flow chart illustrating the respective steps which a user goes through 
while creating a note in freehand on one of the notesheets; 

[023] Figure 12a is a plan view of one of the notesheets when a tip of a writing instrument 
is just used to contact the notesheet; 

[024] Figure 12b is a plan view of a graphics tablet of the desk unit on which the 
notesheet is located, illustrating where the graphics tablet detects the location and 
pressure of the writing tip of the writing instrument; 

[025] Figure 12c is a table illustrating information received by the computer when the 
writing tip is as shown in Figure 12a; 
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[026] Figure 12d illustrates a graphic display on a video display of the computer when the 

writing tip of the writing instrument is positioned as in Figure 12a; 

[027] Figure 13a is a plan view of the notesheet after the user has just started a note in 

freehand; 

[028] Figure 13b is a plan view of the graphics tablet, illustrating how the graphics tablet 
sequentially detects distinct locations of the writing tip of the writing instrument; 
[029] Figure 13c is a table like the table in Figure 12c which is updated with information 
when the writing tip is as shown in Figure 13a; 

[030] Figure 13d is a view similar to Figure 13c when the user starts creating a note in 
freehand like the note in freehand created on the notesheet as shown in Figure 13a; 
[031] Figure 14a is a plan view of the notesheet after the user has created one element of 
the note in freehand thereon; 

[032] Figure 14b is a plan view of the graphics tablet illustrating how the graphics tablet 
has sequentially detected respective positions of the writing tip of the writing instrument; 
[033] Figure 14c is a table like the table of Figure 13c which is updated with information of 
a freehand element created as shown in Figure 14a; 

[034] Figure 14d illustrates how the note in freehand is represented on the new note on 
the video display unit; 

[035] Figure 15a is a plan view of the notesheet after the user has added another element 
of the note in freehand and a command element within a printed command area; 
[036] Figure 15b is a plan view of the graphics tablet illustrating respective areas of the 
graphics tablet, each located directly below each one of a number of command areas of 
the notesheet; 

[037] Figure 15c illustrates the display on the video display unit when the note in freehand 
is finally created as shown in Figure 15a; 
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[038] Figure 1 6 illustrates an address book database which is updated so as to include an 
additional entry which is a copy of the new note created as shown in Figure 15c after the 
user has created a command element within one of the command areas on the notesheet 
as illustrated in Figure 15a; 

[039] Figure 1 7 illustrates a command element address book located in the computer; 
[040] Figure 1 8 illustrates the computer which is connected to a number of recipient 
computers over a network; 

[041] Figure 1 9 illustrates a packet of code and information which is sent over the network 
to one of the recipient computers, the recipient computer depending on the network 
address in the command element address book of Figure 17, and on the command 
element entered by the user in a selected one of the command areas 50 of the notesheet; 
[042] Figure 20 illustrates a graphic display created by code of the packet and an engine 
on a recipient computer, the graphic display having elements which look like the elements 
of the note in freehand created on the notesheet; 

[043] Figure 21 is a diagram of an embodiment illustrating a subsystem form selection 
according to an embodiment of the invention; 

[044] Figure 22 is a flow diagram illustrating how the subsystem of Figure 21 is 
implemented. 
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DETAILED DESCRIPTION 

[045] Figure 1 of the accompanying drawings illustrates a kit 20 for recording a note in 
freehand. The kit 20 includes a container 22 and a desk unit 24, stacks of notesheets 26, 
a computer readable medium in the form of a CD-ROM 28, a receiver/connector assembly 
30, and a writing instrument 31 such as a pen or a pencil located within the container 22. 
[046] Figure 2 and Figure 3 illustrate one notesheet 32 of one of the stacks 26. The 
notesheet 32 includes a paper writing sheet 34, ink 36 printed on a front of the writing 
sheet 36, and a sticky material 38 on a back of a writing sheet 34. The writing sheet has a 
width W and a length L. The ink 36 is located on an edge of the writing sheet 34, thus 
leaving enough open space 40 for creating a note in freehand of the writing sheet 34. 
[047] The ink 36 is laid out in the form of a first, second, third and fourth block 42, 44, 46 
and 48 respectively. A respective command area 50 is thus defined within each block 42, 
44, 46, and 48. The word "Address" is printed next to the first block 42, the word 
"Calendar 3 ' is printed next to the second block 44, the words "To-Do" are printed next to the 
third block 46, and the word "Internet" is printed next to the fourth block 48. The words 
printed next to the blocks 42 to 48 are command functions, each indicting a different 
function to be performed by a user's computer at a remote location as will be described in 
more detail hereinbelow. 

[048] The sticky material 38 is located in a strip on an edge on one side only of the back 
of the writing sheet 34. As shown in Figure 4 the writing sheet 34 can be attached to a 
following writing sheet 34A by the sticky material 38. The writing sheet 34A has a sticky 
material 38A only on a side thereof opposing a side to which the writing sheet 34 is 
attached thereto. The sticky material 38A is used to attach the writing sheet 34A to a next 
writing sheet 34B which is similar to writing sheet 34. By attaching the writing sheets 34, 
34A, 34B etc. in such a manner the stack 26 is thus in the form of a fan or a concertina. 
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[049] Figure 5 and Figure 6 illustrate the desk unit 24 in more detail. The desk unit 24 is 

in the form of a desk pad 70 having a lower surface 72 which can be positioned on a desk 

74. The desk pad 70 includes a housing 76 and a graphics tablet 78. 

[050] The housing 76 includes a front portion 80 and a rear portion 82. 

[051] The front portion 80 has a recess 84 having a periphery 86. The graphics tablet 78 

is mounted within the recess 84 so that the periphery 86 forms an aperture through which 

the graphics tablet 78 is visible from above. Lines are printed or otherwise defined on the 

graphics table to indicate a selected area that has a width W1 and a length L1 . 

[052] The rear portion 82 includes a partial enclosure 90 and a lid 92 which is pivotally 

secured to the partial enclosure 90 by a hinge 94. An opening 98 is formed through the lid 

92. 

[053] In use, the lid 92 is opened so that one of the stacks 26 can be inserted into the 
partial enclosure 90. An upper one of the notesheets 32 is then partially inserted through 
the opening 98. The lid 92 is then closed to that the partial enclosure 90 and the lid 92 
jointly define a receptacle 100 for the stack 26. The receptacle 100 has internal 
dimensions which are slightly larger than the stack 26 to allow for housing of the stack 26. 
The opening 98 is relatively narrow in one dimension when compared to the length one of 
the notesheets 32, and is at least as wide as one of the notesheets 32 in a cross 
dimension. 

[054] The notesheet 32 may be pulled out of the receptacle 100. The following notesheet 
32A then follows the notesheet 32 out of the receptacle 1 00. The notesheet 32 is then 
detached from the notesheet 32A which, in turn, has a portion located externally of the 
receptacle 100. A weight (not shown) may be attached to the receptacle to prevent lifting 
of the housing 76 when the notesheets 32 and 32A are pulled out. The sticky material of 
the notesheet 32 remains thereon and can be used again for attaching the notesheet 32 to 
another surface. 
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[055] The graphics tablet 78 has an upper surface 1 10 on which the notesheet 32 can be 
positioned and attached thereto. The width W1 of the selected are defined by the lines is 
only slightly wider than the width W of the notesheet 32, and the length L1 of the selected 
area is only slightly longer than the length L of the notesheet 32. The selected area also 
defines an orientation of how the notesheet 32 is to be located, i.e. within relatively tight 
tolerances. Provided that the command areas 50 are always printed at substantially the 
same locations on the writing sheet 34 of the notesheet 32, 32A etc. and because the 
notesheet 32 is located within relatively tight tolerances on the graphics tablet 78, the 
command areas 50 are always located over the same areas of the graphics tablet 78. 
[056] The graphics tablet 78 has an array or a matrix which senses where and when 
pressure is applied thereto. The graphics tablet 78 also detects how much pressure is 
applied thereto. When a writing instrument is thus used to create a note in freehand on the 
notesheet 32, pressure is applied to an area of the graphics tablet 78 directly below a 
writing tip of the writing instrument. Graphics tablets are known in the art. The graphics 
tablet may, for example, be a thread of overlying wires. When pressure is applied to the 
wires, the capacitancies of the wires will change. An output can be provided by the 
graphics tablet which, at each moment in time, provides information of where, and the 
magnitude of pressure which is applied thereto. Alternatively, the graphics tablet 78 may 
be a stack of resistive sheets separated by a perforated insulator such that, when the stack 
is compressed by the writing instrument, the sheets act as an orthogonal resistor bridge. 
Other graphics tablets may also be used. 

[057] Figure 7 is a block diagram of the desk unit 24 including the graphics tablet 78. In 
addition to the graphics tablet 78, a signal converter 1 12 and a transmitter 1 14 are also 
mounted to the housing 76. The graphics tablet 78 provides an analog output 1 16 of 
where pressure and how much is applied thereto at each moment in time. The signal 
converter 1 12 receives the analog output 116 (and therefore also information of the note in 
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freehand) from the graphics tablet 78. The signal converter converts the analog signal 116 
to a digital signal 1 1 8. The digital signal 1 1 8 includes information of where pressure is 
applied to the graphics tablet 78 at that moment, and, over time, therefore also what the 
note in freehand created on the notesheet 32 looks like as well as the pressure applied at 
each point of the note in freehand. 

[058] A transmitter 1 14 receives the digital signal 1 1 8 from the signal converter 1 12 and 
transmits a wireless signal 120 to a remote location. The transmitter 1 14 is typically an 
infrared or radio frequency transmitter and the wireless signal 120 is typically an infrared or 
radio frequency signal. An advantage of a radio frequency signal is that no line of sight is 

y required between the transmitter 1 14 and a receiver. Infrared transmitters are however 

h 

p less expensive than radio frequency transmitters and usually allow for more bandwidth. 

m 

*p The wireless signal 120 includes information of where pressure is applied to the graphics 

g tablet 78 at that moment and, over time, information of what the note in freehand created 
on the notesheet 32 looks like, and how much pressure and the moment in time of each 

0 point of the note in freehand. 

jjj [059] Figure 8 illustrates the receiver/connector assembly 30 which is used in combination 

O with a computer 150. The receiver/connector assembly 30 includes a receiver 152, an 

l 

extension 154, and a connector 156. One end of the extension 154 is connected to the 
receiver, and an opposing end of the extension 154 is connected to the connector 156. 
The connector 156 may be a serial port connector, a parallel port connector, a universal 
serial bus (USB) connector, a firewire or any other connector which can be used for 
interfacing with the computer 150. A receiver may, alternatively, be built into a computer. 
The receiver 152 is typically an infrared receiver which can receive the infrared signal 120 
transmitted by the transmitter 114. The receiver 1 52 then provides the signal to the 
computer 150 via the extension 154 and to a connector 156. The computer 150 thus 
receives information of where and how much pressure is applied to the graphics tablet 78 
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at that moment, and, over time, information of what the note in freehand created on the 
notesheet 32 looks like and how it is created in terms of time and pressure applied. 
[060] Figure 9 illustrates a program 170 which is stored on the CD-ROM 28. The program 
170 includes display logic 172, communication logic 174, new note activation logic 176, 
smoothing logic 178, command function logic 180, and timing logic 182. The program 170 
is loaded into the computer 150. 

[061] Figure 10 illustrates the computer 150 in more detail. The computer 150 includes a 
processor 202, a main memory 204 and a static memory 205 which communicate with 
each other by a bus 206. The computer 150 is further shown to include a video display 
unit 208 e.g. a liquid crystal display (LCD). The computer 150 also includes an alpha- 
numeric input device 210 (e.g. a keyboard), a cursor control device 212 (e.g. a mouse), a 
disk drive unit 214, a signal generation device 216 (e.g. a speaker), and a network 
interface device 218. The CD-ROM 28 including the program 170 is inserted into the disk 
drive unit 214 and installed on a hard drive of the computer 150. Some instructions of the 
program are loaded into the computer. Once the program 170 is loaded into the computer, 
software 220 resides, completely or at least partially, within the main memory and/or within 
the processor 202. Some of the software also remains on the hard drive. 
[062] The desk unit 24 is usually located on a desk of a user. The computer 150 may be 
located in the general vicinity, but remotely from the desk unit. The desk unit is then used 
for relaying information of what a note in freehand created on one of the notesheets 32 
looks like. The computer 150 receives the information, provides a display of the 
information, and also stores the information at different locations. 
[063] Figure 1 1 illustrates how a user records a note in freehand utilizing the kit 20 
hereinbefore described. In step 250 the user contacts the notesheet located on the 
graphics tablet with a writing tip of a writing instrument such as a pen or a pencil. In step 
252 the user starts writing on the notesheet. In step 254 the user completes one element 
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of a note in freehand on the notesheet. In step 256 the user optionally writes another 
element on the notesheet. In step 258 the user optionally writes a command element on 
one of the command areas of the notesheet. Steps 250-258 are now illustrated with 
reference to Figure 12, Figure 13, Figure 14, and Figure 15. 

[064] Figure 12a illustrates the notesheet 32 which is located on the graphics tablet 78. A 
user contacts the notesheet 32 with a writing tip 302 of a writing instrument 304 such as a 
pen or a pencil. (Step 250). The writing instrument 304 may be the writing instrument 31 
included in the kit 20, or may be any other writing instrument that is readily available. 
Figure 12b illustrates that the graphics tablet 78 has a location 306 directly below the 
writing tip 302 where the graphics tablet 78 senses that pressure is applied thereto at the 
location 306. The graphics tablet 78 sends a signal to the computer 150 of coordinates of 
the location 306 and how much pressure is applied thereto at the location 306. Figure 12c 
illustrates information received by the computer 156 due to the writing tip contacting the 
notesheet 32 as shown in Figure 12a. The computer 150 receives the information of the 
location 306 at a moment in time (t1) which is when the writing tip 302 contacts the 
notesheet 32. The information received by the computer of the location 306 includes the 
coordinates (x1; y1) of the location and the amount of pressure (p1) applied at the location 
306. Figure 12d illustrates a visual display on the video display 208. The display logic 1 72 
displays a number of notes 312 in a stack 314. The notes 312 are located visually behind 
one another and are organized chronologically by time of creation. Month and year 
separators 31 6 are located between the notes 31 2. Each month separator 31 6 has a 
respective tab 318 which indicates the month of the notes that follow. Utilizing the cursor 
control device 212, a user may click on the one of the tabs 31 8 to access the notes 316 of 
that month, and then click through the notes to find the note that the user is looking for. 
Alternatively, a user may also use other means, such as categories, to organize the notes. 
The category of each note may be entered utilizing block letters written on the notesheet, a 
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keyboard or other device. The user may access a required note by searching utilizing time, 
block letters, or keystrokes. 

[065] The computer receives the information about the coordinates of the location 306, 
and adds an additional note 326 to the last note 312 of the stack 314 by first drawing a 
rectangular border 327 and then filling the border 327 with color such as yellow. A dot is 
added to the note 326 at the coordinates corresponding to the location 306. The computer 
150 may provide an audible notification via the signal generation device 216, such as 
"beep" sound, when receiving the information relating to the location 306. 
[066] Figure 13a illustrates the user starting to create a note in freehand on the notesheet 
32. (Step 252). The writing tip 302 moves over the notesheet 32 to create a line 320. 
Figure 13b illustrates the graphics tablet 78 again being depressed at a location 322 which 
is displaced from the location 306. For purposes of illustration only the locations 322 and 
306 are shown, but it should be understood that the graphics tablet 78 may have detected 
locations between the locations 306 and 322 while the user created the line 320. 
Coordinates of the location 322 are again provided to the computer 150. Figure 13c 
illustrates that the computer 150 now receives information of the location 322. The 
information of the location 322 include the moment in time (t2) when the writing tip 302 m 
moves over the location, the coordinates (x2, y2) of the location 322, and the pressure (p2) 
applied at the location 322. A line 328 is also added to the note 326 from the coordinates 
of the location 306 to the coordinates of the location 322, as shown in Figure 13d. 
[067] Figure 14a illustrates the user completing one freehand element 330 of a note in 
freehand on the notesheet 32. (Step 254). As shown in Figure 14b, the graphics tablet 78 
detects the position of the writing tip 302 sequentially at a number of additional locations 
334. The coordinates of each location 334 are also forwarded to the computer 150 when 
detected. Figure 14c illustrates the information received by the computer. For each one of 
the locations 334 the computer receives information regarding the moment in time (t3...tn) 

04106.P001X 13 



when pressure is applied to the respective location 334, the coordinates (x3; y3...xn;yn) of 
the respective location 334, and the pressure (p3...pn) applied at the respective location 
334. The smoothing logic 178 fits a smoothing curve 336 through the coordinates of the 
locations as shown in Figure 14d. Smoothing curves are known in the art. The smoothing 
curve 336 looks the same or at least substantially the same as the element 330 on the 
notesheet 32. It can thus be seen that electronic versions of notes can be created with an 
ordinary pen or pencil. 

[068] A person may then create another freehand element 340 on the notesheet 32 as 
illustrated in Figure 15a. (Step 256). The user may then utilize a user predesignated 
penstroke, recognized by the computer, which indicates that the note 326 is complete. A 
new note will then be created when the user again depresses on the graphics tablet 78. 
Alternatively, the timing logic 182 determines the amount of time from when the element 
330 is finally completed until when the creation of the element 340 is started. Depending 
on the amount of time between the elements 330 and 340, the timing logic determines 
whether a new note should be created or not. If the amount of time is less than, for 
example, five minutes the timing logic determines that element 340 is part of the same note 
as the element 330 and adds a curve 342 on the note 326. A new note will only be created 
if the amount of time is more than five minutes. Alternatively a user may create a 
penstroke to indicate that a new note should be created. The note 326 may then have a 
curved border, blink, or otherwise indicate that some action should be taken such as saving 
the note 326 in another database or viewing the note 326 for correctness. The user may 
then access the note 326, change it, or save it in any desired location. It may also be 
possible for the user to carry out any operations on the note 326 as on the notesheet 32, 
which correspondingly similar reaction by the computer. 

[069] As also illustrated in Figure 15a, the user may, additionally, write a command 
element 400 in one of the command areas 50. (Step 258). Because the notesheet 32 is 
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accurately located in a selected area over the graphics tablet 78, the command element 
400 will always be detected in one of four areas 402 of the graphics tablet 78. A ridge (not 
shown) may be located on the graphics tablet 78 to prevent or hinder a user from writing on 
the command areas while creating the element 340 or 330. The graphics tablet 78 
provides information of the coordinates of the command element 400 to the computer 150. 
The computer 150 may display the command element as an element 404 on the notesheet 
326. In addition, the note 326 may include fields which correspond in appearance to the 
areas 50 and other ink printed on the notesheet 32. More importantly is that the command 
function logic 180 recognizes that the command element 400 is detected within one of the 
areas 402, which area 402 detects the command element 400, and sometimes also what 
the command element 400 looks like. The use of a command element such as the 
command element 400 is now described in more detail. It should be noted, that, although 
the command elements are created on the notesheet as hereinafter described, the logic in 
the computer may also allow for manipulating of the computer by creating command 
elements on the note itself with reaction of the computer in an identical manner as 
hereinafter described. 

[070] Figure 1 6 of the accompanying drawings illustrates an address book database 500 
within the computer 150. The address book database 500 includes a number of address 
book entries 510. Address book databases are known in the art and can be created and 
accessed with known computer applications. 

[071] As shown in Figure 15a, the user creates the command element 400 in the 
command area 50 with "Address" next to it. The graphics tablet 78 detects where the 
command element 400 is created, namely directly above one of the areas 402, and 
transmits the coordinates of the command element 400 to the computer 150. The 
command function 180 determines that the coordinates of the command element 400 
respond to the command area 50 with "Address" next to it. Then, upon determination of 
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the coordinates of the command element 400, the command function logic 180 creates a 
copy of the newly created note 326 and stores the copy as a new address book entry 512 
in the address book database 500. The computer 150 may automatically convert the entry 
512 to text, or a user may subsequently manually convert the entry 51 2 to text utilizing the 
alpha-numeric input device 210. It can thus be seen that entry of records into a database 
such as the address book database 500 can be done without the complications of calling 
special commands on a computer or following complex protocol or wait for an application 
to be activated. An electronic version of a hard copy is thus be created and stored and can 
be easily and automatically processed. The entry 512 may be stored in a buffer database 
for later access. Alternatively a user may type on the note 326 to designate a filing 
location, or separately type block letters to designate a filing location. 
[072] The address book database 500 may be viewed, utilizing a suitable application, on 
the video display unit 208 of the computer 150. A user will then see that there is a new 
address book entry 512. The user may then access the new address book entry 512 in the 
address book database 500. When the new address book entry 512 is opened, a note 
appears which is the same as the note 326 in Figure 15c. 

[073] Similarly, a calendar database and a "To-Do" database may also be located in the 

computer 150. When a user creates an element on one of the areas 50 with "Calendar" or 

"To-Do" next to it, a copy of the note 326 will be stored in either the calendar database or 

the "To-Do" database. Other databases may also be designated. 

[074] The use of the command area 50 with "Internet" next to it is now described in more 

detail. 

[075] Figure 17 illustrates a command element address book 520 which is stored on the 
computer 150. The command element address book 520 includes a number of different 
network command elements 522 and a number of different network addresses 524. Each 
network address 524 corresponds to a respective one of the network command elements 
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522. The network command elements 522 are freehand elements which may be 
preinstalled on the computer 150 or may be entered by a user when installing the program 
170, perhaps by using the desk unit 24 or perhaps using block letters entered by the alpha- 
numeric input device 210. 

[076] A user may create a command element within the command area 50 with "Internet" 
next to it. The graphics tablet 78 provides the coordinates of the command element to the 
computer 150. In addition, the graphics tablet 78 provides information to the computer 150 
of what the command element looks like. The command function logic 180 then compares 
the information of what the command element looks like with each one of the network 
command elements 522. The network command element 522 which corresponds most 
closely to the command element created within the area 50 with "Internet" next to it is then 
used to access a corresponding network address 524. For example, if a command 
element is created which looks more or less like an encircled "X" the third network address 
(Network address 3) is read from the command element address book 520. 
[077] Figure 18 illustrates a number of computers connected in a network configuration 
over a network 532 such as the Internet. The computers include the computer 150 of the 
user, and a number of recipient computers 530. Each recipient computer 530 has a 
different respective network address. The computer 150 of the user sends a packet of 
code and information to one of the recipient computers 530. The recipient computer 530 to 
which the packet sent is the one with the network address which is read from the command 
element address book 530. For example, should the third recipient computer 530A 
(Recipient 3) have the third network address (Network address 3), then the packet will be 
sent to the third recipient computer 530A. 

[078] Figure 1 9 illustrates a packet 600 which is sent to the recipient computer 530. The 
packet 600 includes information 610 of the note created on the notesheet. More 
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specifically, the information includes all the information of the element 330 as represented 
by the table in Figure 14c. 

[079] An engine 614 is located on the recipient computer 530. The code 612, when 
received on the recipient computer 530A, automatically interacts with the engine 614 to 
control the recipient computer 530A. Figure 20 illustrates a video display unit 620 of the 
recipient computer 530A. The code 612 and the engine 614 creates a note 622 displayed 
on the video display unit 620 by again drawing borders and filling the borders with color. 
The information 610 is used to create a number of elements 624 in the note 622. The 
elements look the same as the note in freehand created on the notesheet 33. (See Figure 
15a). 

[080] In addition, software on the recipient computer 530A may analyze the information, 
including the information in the table in Figure 14c. The note created in freehand on the 
notesheet 32 may, for example, be a signature. The information may be used to 
authenticate the signature against proof data on the recipient computer 530A. The 
coordinates may, for example, be authenticated against the data on the proof of the data. 
In addition, since each point of the note corresponds with a certain movement in time, the 
speed and acceleration of the writing tip 302 can be determined at each moment in time 
and be compared with the proof data. An amount of pressure applied at each point is also 
included in the information and can be prepared with the proof data. 
[081] A button 626 is also created on the notesheet 622. When the recipient clicks on the 
button 626, the recipient computer opens a web browser. The web browser may then 
automatically open an Internet website with information of a kit such as the kit 20 
hereinbefore described, sales information thereof, and more code that can be used to 
enhance the note 622. A sending user may also select a "signature" while creating the 
note in free hand on the notesheet 32. Such "signature" may determine other features of 
the note 622, such as a border, color or inclusions such as sounds of the note 622. The 
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user may, for example, select such a "signature" by creating a character in another 
command area such as one of the command areas 50. 

[082] It can thus be seen that the hardware including the desk unit 24 and the stack of 
notesheets 26 need not necessarily be complicated or expensive. In particular, there may 
be no need for providing a processor within the desk unit 24. 
[083] The use of the hardware is also relatively uncomplicated. The only functions 
performed by a user is to locate one of the notesheets 26 on the graphics tablet 78, 
creating a note in freehand on the notesheet, and, maybe, creating a command element 
within one of the command areas 50. Simple handwriting data can be entered into a 
computer without a user having to look at a screen while concentrating on another task 
such as speaking with someone, or without having to wait for a specific computer program 
to be activated. 

[084] Regardless thereof that the hardware and the use thereof are relatively 
uncomplicated, relatively complex functions can be performed by the software on the 
computer 150. These functions include sending a note over the Internet and controlling a 
recipient computer. 

[085] One use of a kit as herein before described is for electronically recording 
handwritten notes. Such a kit may also find application in other fields such as commerce. 
A kit may for example include standard forms by bank tellers, receptionists, medical 
doctors for prescriptions, or credit card verifiers. A desk unit may be included with areas 
indicated for positioning of the forms. The software may include a list of templates from 
which a user may select a template corresponding to the forms used. The templates 
provides for a two-dimensional layout that corresponds in appearance to the ink printed on 
the form. The template may also be modified or customized or the user may be able to 
create templates that correspond to forms that are designed and printed to requirement. A 
computer form can also be created which can be printed to provide a plurality of 
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notesheets and which can form the basis of mapping command areas, recognized by the 
computer, to an actual notesheet that is used. 

[086] In one embodiment, information of each template created on a computer is stored in 
a template table to be used to display the template with the freehand notes of the 
handwriting on the form. The template information includes a suite of gestures that the 
user associates with the template and with which the template may be retrieved, as will be 
described. 

[087] Figure 21 illustrates how forms can be selected in a system 900, according to an 
embodiment. The system 900 includes a plurality of forms 905a-905i, a transmitted signal 
908, a template table 910, a plurality of computer level templates 920a-920i, and the 
computer display 208. Figure 22 illustrates how the form selection is implemented. The 
following description illustrates the manner in which freehand notes on a form is displayed 
on a computer level template to be recorded, with reference to figures 21 and 22. 
[088] At block 810, the user selects form 905b from the pluralities of forms 905a-905i to 
be placed on the graphics table 78 to have a freehand note handwritten thereupon. Each 
of the plurality of forms 905a-905i has characteristics that differentiate each form. The 
selected form 905b may be, for example, an Order Requisition form to be used to request 
supplies by handwriting the items to be ordered. As shown, the freehand note 943 of 
'Nails' is handwritten on the selected form 905b. 

[089] At block 820, the user selects to have a template displayed by marking a suite of 
gestures in the command area 941 and 942 on the selected form 905b. Because the 
selected form 905b is accurately located in selected control areas (not shown) over the 
graphics tablet 78, a suite of gestures could be used to indicate the computer-level 
template to be used to display a freehand note 943 on the computer display 208. Here, 
each form of the plurality of forms 905a-905i is associated with a specific integer 
designation one thru ninety-nine. Each form 905a-905i has a "tens" command area 941 , 
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and a "units" command area 942, with which the user selects to have any freehand note 
displayed on a specific template associated with the form. Form 905b, as illustrated, 
shows how the user identifies the form by marking the gesture 946 in the "tens" command 
element 941 , and the gesture 947 in the "units" command area 942. The suite of gestures 
becomes a unique template identifier, corresponding to the form selected, to identify a 
computer-level template to be displayed, as will be described. 

[090] The graphics tablet 87 then transmits and the computer 150 receives the signal 908 
of information that includes the suite of gestures and the information of the freehand notes 
(830). 

u [091] At block 840, a template to be displayed is selected from the template table 91 0 

3 based on a comparison of the suite of gestures in the signal with the plurality of different 

m 

jj computer level templates in the template table 91 0. The template table 91 0 includes a 
p } "tens" and "units" column containing the suite of gestures and a pointer to a template. 

Upon accessing the row in the table that corresponds or closely corresponds with the suite 
jj of gestures in the signal, the associated template is selected. Here, the suite of gestures in 
2 the signal is a unique template identifier associated to the computer level template. As 
O shown in the template table 91 0, the suite of gestures '02' stored in the table 910, are 
associated with the template 920a; the suite of gestures '25', stored in the template table 
910, are associated with the template 920b; and the suite of gestures '26', stored in the 
template table 910, are associated with the template 920c. It should be understood that 
the pointer to a template may be a pointer to template data describing the characteristics of 
the template. 

[092] At block 850, upon identifying the appropriate template, the computer 150 displays a 
two-dimensional image of the template and the note in the signal 908 on the computer 
display 208. The two-dimensional image is the same as a layout of the form 905b. The 
freehand note 943 is displayed in the location and in the style on the template substantially 
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similar to the coordinates and style of the freehand note on the form 905b. The freehand 
note may also be in a cursive style of handwriting (e.g., a signature). The computer 150 
recognizes the cursive note and displays a curve corresponding to the cursive note on the 
selected template in the location similar to the coordinates of the freehand note on the 
form. 

[093] In an alternative embodiment, the computer 150 also displays a two-dimensional 
image of the suite of gestures in the location on the template substantially similar to the 
coordinates on the form 905b. 

[094] At block 860, an electronic representation of the selected template and freehand 
note are stored in a datastore. In an alternative embodiment, the electronic representation 
of the suite of gestures is also stored with the selected image. 
[095] It should be appreciated that handwriting on a form positioned on top of a kit, as 
herein before described, provides for the display and recording of an electronic copy, as 
well as a physical hardcopy, of the handwritten note. Standard forms used in various 
industries may be displayed and recorded on a template, corresponding to the form, on a 
remote computer display of another person nearby. The electronic recording of the form 
eliminates the need of personnel to manually perform data entry of the handwritten 
information from the form into a computer system. 

[096] It will be appreciated that that more or fewer processes may be incorporated into 
the method(s) illustrated in Figure 22 without departing from the scope of the invention and 
that no particular order is implied by the arrangement of blocks shown and described 
herein. It further will be appreciated that the method(s) described in conjunction with Figure 
22 may be embodied in machine-executable instructions, e.g. software. The instructions 
can be used to cause a general-purpose or special-purpose processor that is programmed 
with the instructions to perform the operations described. Alternatively, the operations 
might be performed by specific hardware components that contain hardwired logic for 
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performing the operations, or by any combination of programmed computer components 
and custom hardware components. The methods may be provided as a computer program 
product that may include a machine-readable medium having stored thereon instructions 
which may be used to program a computer (or other electronic devices) to perform the 
methods. For the purposes of this specification, the terms "machine-readable medium" 
shall be taken to include any medium that is capable of storing or encoding a sequence of 
instructions for execution by the machine and that cause the machine to perform any one 
of the methodologies of the present invention. The term "machine-readable medium" shall 
accordingly be taken to included, but not be limited to, solid-state memories, optical and 
magnetic disks, and carrier wave signals. Furthermore, it is common in the art to speak of 
software, in one form or another (e.g., program, procedure, process, application, module, 
logic...), as taking an action or causing a result. Such expressions are merely a shorthand 
way of saying that execution of the software by a computer causes the processor of the 
computer to perform an action or a produce a result. 

[097] It should be understood that although the invention is described as providing a suite 
of gestures to identify a corresponding computer-level template, in alternative 
embodiments, other characteristics or information about the form might be used to select a 
template that most closely corresponds to the form. In addition, upon identifying the 
appropriate template, the computer 150 may display the recorded template and the notes 
via alternative remote output devices, such as, a printer device, a facsimile device, among 
other examples. 

[098] While certain exemplary embodiments have been described and shown in the 
accompanying drawings, it is to be understood that such embodiments are merely 
illustrative and note restrictive of the current invention, and that this invention is not 
restricted to the specific constructions and arrangements shown and described, since 
modifications may occur to those ordinarily skilled in the art. 
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